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^;rot inn System and M ethod 

The present invention relates to a communication system and method. The mvention 
furthd relates to a transmitter apparatus and a receiver apparatus for use with the 
system and to a subscriber apparatus for communicating with at least one of the. 
transmitter and receiver apparatus. 

The invention m*v he applied to the Held of remote control unit, for consumer 
broadcast receiver,, including television and radio receivers. The -nvention relates to 
the displav of (possibly programme-related) information, advening, and product and 
serv ,ce offers on said remote control units. The invention provides use of said uu.u to 
a l,ow consumer respox.se to the sa,d displays, particularly but not exclusively where 
sa.ri response involves the purchase of said products and services so offered. 

It is commonly known in the advertising, sales and marketing ans that users are much 
more likely to initiate an impulse purchase of information, products and semces 
(collectively, ' offerings') if • 

1) they are induced to think about said offerings in a positive manner shortly prior to 

the offer of sale, 

an offer of sale is, in fact, made and 
3) it is fast and easy for us«s to place orders for such offering,, once the offer of sale 

has been made. 

Broadcast media, such as tclevis.on and radio, often satisfy the fitsi condition for many 
Offerings, for example, upon hearing a nek from an album on the radio on the ra dl o, a 
listenei will commonly wish to purchase that album. Similarly, upon watchmg a 
cookery programme on television, a viewer may wish to purchase a bottle of win. 
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reviewed therein. Indeed, condition 1) forms a key premiss of many television shopping 
channels, infomercials and commercials in die United States and elsewhere. 

Unfortunately, however, condition 2) is often unsatisfied, as, for example, when a radio 
station does not broadcast the name of the artist and album of the current song, or where 
(as in the cookery programme example) there is no provision to phone in orders (which 
is a costly eniciutise for the broadcaster to maintain). Many commercial opportunities 
TO make a sale arc lost in this way. 

Furthermore, even when 1) and 2) are satisfied (as with a television shopping channel), 
it is usually the case that 3) is not. Users who might initially be keen to purchase an 
offering become less so when such purchase involves location of a credit card, phoning 
up, waiting in an answering system, and Then having to give a number of lengthy 
details. Lack of convenience acts as a strong barrier to sales. 

Various solutions have been proposed in the an tu ihe various problems of 1), 2) and 3). 
However, a good, economical solution has noi yet been offered to all three. 

U.S. Pat. No. 5,410,320 (Goldstein) describes the use of a universal remote control 
device with a built in display on which advertisements can be shown. The system does 
allow purchasing; however, this requires the use of a phone modem, which is highly 
inconvenient, end also, since the system connects directly to the sponsoring party, may 
require direct data handling for which that parry is not equipped. Furthermore; 
downloading data into the device requires either the use of the said modem, a set-top 
box adaptor (to gain access to in-band or out-of-band Programme Associated Data 
(PAD)), an optical device to 'read 1 information off the television screen, or an audio 
device to detect information hidden in audio signals. The disadvantage of using the 
phone modem ro download PAD is clear, in that a call must be made, which is 
inconvenient, and since there is both a limited memory in the device (limiting the 
amouni Of static information which can be downloaded) and occasions when the PAD 
will be highly volatile and not known ahead of time (as with sporting events), the 
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solution is not general. The disadvantages of using a seMop box, namely cost and 
complexity, are easily understood, as are the difficulties suffered by 'data-hiding' or 
visual indicia systems (low code rate, low reliability). Therefore, while this device has 
some promise, it must fall down in being manifest either as a workable but very 
expensive unit, or a mid-priced but less than useftil one. 

It is. accordingly, an object of the present invention to provide an economical channel 
for at least one uf uui^uiu^ or Incoming information, avoiding the disadvantages of the 
channels currently in use in the an, for the transmission of interaction data to or from 
ihe instant device. 

According to a first aspect of the present invention, there is provided a communications 
apparatus comprising means for determining whether a broadcast receiver is receiving a 
particular channel, the apparatus further comprising receiving means for receiving a 
sicmal, means for displaying information in response to a signal received by the 
receiving means, means responsive to a user input fo provide an outgoing signal and 
transmitting means for transmitting the outgoing signal, wherein at least one of the 
receiving means and the transmitting means is for communicating by radio with a 
remote station responsive to outgoing signals from a plurality of communications 
apparatus. 

According to a second aspect of the present invention, there is provided a transmitter 
apparatus comprising means for storing information concerning transmission from a 
primary broadcaster, means for transmitting the information and means for 
synchronising the transmission of information to at least one transmission from the 
primary broadcaster, wherein the means for transmitting information transmits distinet 
from the primary broadcast chain. 

Looking generally at the issue of presenting programme-related offerings to a user via 
an apparatus, one can see that there is a need to have an outbound channel holding the 
programme-associated data, which is broadcast to the user in parallel with the 
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programme channel, and which is picked up by the said apparatus. However, as we 
have seen, current mechanisms for sending offering-related PAD requires that the data 
be sent in the same medium as the programme, which in turn requires either a costly 
set-top box decoder, an unreliable (and broadcaster-tied) 'data-hiding 5 decoder, or the 
duplication of the receiver circuitry in the receiver, which would also be vci y 
expensive. Broadcast of PAD using other channels cither lias significant drawbacks (as 
with the use of telephone channels, which are inconvenient, non-broadcast, and not 
amenable to ' real-time' PAD), or has not yet been applied to the distribution of 
offering-related PAD (as with die systems which use the pager network as a transport). 

The pjesent invention may further provide an offering related PAD broadcast channel 
which can be received by a device without the use of a set-top box. telephonic modem, 
or other external inconveniences, and which does not rely upon to co-operation of 
anyone in the primary broadcast chain to insert information (whether using out-of-hand, 
in band, using data hiding or otherwise) into the programme broadcast medium. 

Similarly, it may be appreciated that such a device, if it is to allow useftil purchasing 
and information request actions by customers, must supply a (relatively low-capacity), 
real-time back (or return) channel, to allow interaction data to be conveyed to the 
sponsoring party. Such a back channel must be initiated on a individual basis, as 
opposed to the broadcast iwtuic of Lhe outbound channel. Existing systems rely on 
back-channel yaths with arc cither inconvenient (for example, telephonic modems), 
requite the use of a costly set-top unit (for example, those which exploit the cable 
system as a return path), or arc not 4 real time' or close to 'real time' (as with systems 
which must be taken to a downloading' point to extract any interaction data stored in 
them). Current systems also connect the back channel of the user's system directly to 
the sponsoring party, thereby requiring that the latter he equipped with whatever 
handling equipment may be necessary; another potential hurdle to take-up. 



Notice that such a device, if it is to be generally useftil, must be able to receive PAD 
items in an ongoing feed. There are two main reasons for this. First of all, die fact that 
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any reasonably-priced embodiment of snrh a device can have only a modest amount of 
onboard memory, places a limit on the number of PAD items that can be downloaded to 
it in any given batch mode transfer. Second, for certain events, such as televised live 
horse races, the outcome is not known in advance, and so neithei, a fortiori, is the 
content of any event-related PAD. Such PAD cannot, thcrcfuie, be downloaded in 
advance of the event using a batch mode transfa. 

These two factor, namely limited buffer memory in the device, and the dependence of 
certain PAD items on live events, means that the ongoing feed of PAD to the device 
must take place in "real time" or close to "real time". "Reel time" feed is required in 
the second scenario mentioned, where PAD content is contingent upon an event, the 
outcome of which is unknown until the time of broadcast. Once the event in question is 
n determined (for example, a particular horse wins the race), the relevant PAD may be 

W constructed and is then immediately due for presentation to interested users. Ideally, as 

*fs little additional delay as possible is incurred from this point on; hence the term "real- 

W time". Near "real-time" feed is required in the first scenario, where PAD items 

I j transmitted to the user device must be relevant to a primary broadcast within the near 

W future, if buffer overflow in the device is to be avoided. 

2 

^ The present invention allows the passage of such data to sponsoring panics to be 

jPfl indirected via a central processing station and require only the use of standard, well- 

known protocols for any communication between 3aid central processing station and 

said sponsoring parties. 

The present invention may further allow the presentation to users - through a cost- 
effective, single device - of programme-associated data, particularly where such PAD 
constitutes an offering, and to allow the user to express interaction with the PAD 
through the device, particularly where such interaction consists of the purchase of said 
offerings. 
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The present invention may further allow such PAD to be ' real-time' or 'near real-time', 
and for the interaction data to be conveyed back to the sponsoring party in 'real-time' 
or 'near real-time'. 

The present invention may further provide a solution to the problem of satisfying 
conditions 2) and 3) mentioned above, (given that condition 1) is already satisfied by 
the primary broadcast material), in the form of a simple user device, a plurality of 
which may be in operation at any time, remote adaptor station or stations, and methods. 

In accordance with the aforementioned and other objects of the invention, a brief 
summary of the present invention is given. Some simplifications and omissions may be 
made in the following summary, which is intended to highlight and introduce some 
r i aspects of the present invention, but not to limit its scope Detailed descriptions of a 

^ preferred and other exemplary embodiments adequate to allow those of ordinary skill in 

m the art to make and use the inventive concepts will follow in later sections. 

1 j The present invention provides apparatus and method for pi yvidina simple, efficient 

an( j econoro ir. display of advertisements, product and service offers, and other 
C 3 information (collectively, display data' ) to the users of broadcast receivers, and is 

intended to have paniculai application where said display data is related to the 
B programmes picked up by such receivers. The invention also provides apparatus and 

2 method for users, where applicable, to interact with said display data (for example, to 

k J: 

yjda an offered product or to request more information about an advertised good or 
service), and for the details of such interaction (collectively, 'interaction data") to be 
sent back to the sponsoring party for processing. 

The apparatus, for example a remote control can determine whether a channel is 
selected on a broadcast receiver In the case of a remote control this can be by way of 
selection by a user. A confirmation of the correct channel can be obtained by receiving 
a signal from the broadcast receiver, for example using a microphone and comparing 
the signal with a predetermined signal or a signal received at this apparatus. 
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However, the device may also contain a radio data receiver, which is used to pick up 
display data relevant to the programme that the user is currently watching (or listening 
to). The device is able to filter this incoming data according to the current <mcdium, 
channel> pair, which is known to the device. 



Incoming display data is stored in memory within the said device until it becomes 
eligible for display. Generally, such data will be timed to become eligible for display at 
a point when the programme on The associated channel contains relevant content, 
(thereby satisfying condition 1) mentioned in the background section); in such a 
eiicumsLancc the display data may be termed programme associated data, or PAD, and 
the point in time of activation is known as ihe cue point. The list of PAD items and 
associated cue points, for each progiauune broadcast on a given channel (which can 
include infomcrcials and commercials, for qui pui puses) must be provided to a central 
PAD scheduler, either ahead of time Just in time, or some combination of both. The 
scheduler co-operates with a database system to hold this list, and, at the approbate 
point (either ahead of or at the cue point), passes the next due PAD item, including its 
cueing information, through to a radio transmission system, which it turn sends it to 
users' handsets, as rehearsed above. 

When a PAD becomes eligible for display and is present in the memory of the said 
remote control device, it will be caused to be shown on the display of said device, 
possibly accompanied by certain event indications (such as an audible alarm or flashing 
lamp). 



Various sorts of input signal may be utilized by such a device. For example, a 
serialized PAD software object may be sent, comprising a program, associated state, 
unique identifier (PADUID), relevant <mcdium, channel> specification, and a 
triggering (cueing) time specification. Control messages may also be sent, to cause 
PAD items buffered in any appropriate receiving device to be rescheduled, edited, 
deleted or otherwise manipulated. Simple trigger signals may be sent, to cause any 
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appropriate receiving device to perform some preset operation. Configuration 
information may be sent (including software updates for the main device operating 
routines). "Pure" data may also be sent, devoid of any executable content, such data Tn 
be interpreted (and possibly displayed) by software routines resident in any appropriate 
receiving device. 

If the user desires (and the PAD is of a nature so to permit), s/he may interact with the 
display data by operating controls on the said device. Through this mechanism the user 
may traverse through a siiuoure of displays, or modify state information associated 
therewith, under the control of a flow control program embedded in the display data. 
The user may also move backwaids and forwards through the set of display data items 
which has been received (bounded by the si2e of the memory) if desired. If a user is 
particularly interested in a unit of display data, s/he may cause sa.d unit to be stored in 
non-volatile memory on the said device, fiom where it may be retrieved by the user for 
processing at a later time. In normal circumstances, any given unit of display data is 
eventually e.v,cted from the memory of the device by an incoming unit; this will happen 
whenever the display data memory is full and the given unit is deemed least eligible to 
be retained, under some appropriate metric. 

User imcraciions with each unit of display data are stored, and the flow control piogiam 
contained with each unit may specify at which point (if at all) such interaction data 
should be forwarded to die sponsor of the display data When this point is reached, a 
radio data transmitter in the device is used to send the imeraaion data back, via a radio 
service provider, to the central processing siation. Here, it is fed into an interaction 
processor, which is responsible for pioviding the appropriate response. This may 
involve initiating a transaction on behalf of the user, possibly via an Internet gateway to 
the appropriate sponsoring party, requesting thai the sponsoring party send more 
information, logging the interaction in a user database, performing a financial 
transaction, or otherwise. 
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In response 10 the interaction data so transmitted, it is possible for the interaction 
processor to send back data for the individual consumption of the display data program 
that initiated the transmission of the interaction data in the first place. This mechanism 
may be used, for example, to confirm that an order has been received and will be 
processed. 

The central processing station mentioned above may be part of a large nerwork of such 
stations, which may be arranged in such a manner as to provide transparent 'fail-over* 
of the Transactions of" one processing stations to others. 

When a transaction is performed using the handset, details of that transaction are stored 
in non-volatile memory, and a set of the most recent transactions may be displayed to 
the user on demand. A full record for each user is stored at the central processing 
station handling that usci, and may be downloaded iu the handset on demand. 

From a user's perspective, the device allows an easy, cheap and hassle-free entry into 
the world of interactive broadcasting. Services which may be offered include 
programme-associated selling, schedule information, betting, advertisement follow-up, 
voting, competitions, audience demographic measurement, interactive story lines, and 
many others. 

The present invention will now be descrihed, by way of example, with reference to the 
accompanying drawings, in which: 

FIG. 1 is a plan view of one embodiment of the remote control apparatus of the present 
invention, 



FIGS. 2A through 2L show various exemplary displays of the embodiment of the 
remote control device of the present invention shown in FIG. 1; 
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FIG. 3 is a functional block diagram of an interactive system having a preferred 
embodiment of the present invention, 

FIG. 4 is illustration of the embodiment of ihc i emote control device of the present 
invention shown in FIG. 1 , as it might be used to offer programme-associated goods; 
and 

FIG. 5 is a functional block diagram showing the major components of one 
embodiment of the remote control device of the present invention. Only the major data 
flows are show; minor control flows are not. 

FIG. 6 is a plan view of an alternative embodiment of rhe present invention, as a "pass- 
through" adaptor that may be attached in an existing broadcast receiver remote control 
handsel. 

FIG. 7 A is a plan view of another alternative embodiment of the present invention, as a 
device which passively detects the currently selected <medium, channel> pair, and 
which has no remote control functionality. 



FIG. 7B is a plan view of another alternative embodiment of the piesem invention as a 
if| more restrict ed form of the device disclosed in FIG. 7 A, which relics on use: input to 

C3 set rhe current <medium, channel* pair. 

C3 

FIG. 3 is a functional block diagram of an interactive broadcast system embodying the 
principles of the present invention. The system of FIG. 3 is intended to serve as an 
example and should not be construed as limiting the invention. 

Broadcasters 402 generate content from a number of sources 403, depending on the 
broadcast medium in use. Foi example, a television broadcaster might utilise live feed 
from video cameras, and video played from tape, as primary sources. Commercial 
broadcasters will also have programmes and segments (such as infomercials and 
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commercials) provided by sponsors 401, for insertion. In the normal course of events 
this combined content stream is fed into a transmission mechanism 404 for broadcast to 
into a user's home 416 where the content carrier is acquired and the content 
reconstructed and displayed using a broadcast receiver 405. Said transmission 
mechanism may involve terrestrial radio-frequency broadcast, satellite radio-frequency 
broadcast, or wired or fibre optic cable Transmission, nr otherwise. The overall path 
and system, by means of which content is disseminated from broadcasters 402 to 
broadcast receivers 405 in users' homes 416, is termed the primary broadcast chain 

For the system of the instant invention to operate, as mentioned above, a rolling 4 play 
list* is compiled foT cadi biuadcast channel, containing the PAD display data records 
and ihcii jcspcciive cue point*. This information is fed, whcthci well or only very 
shortly in advance of the earliest cue point in the segment of the rolling list passed at 
that time, to a PAD scheduler 411 at a central processing station 420. Such a list may be 
provided by any combination of the sponsors 401, the broadcasters 402, or by some 
third pony 406 which annotates programmes, either as these programmes are broadcast 
or ahead of time. The use of third party annotation may be useful where a broadcaster 
does not wish, or is not correctly placed, to co-operate with the display of programme- 
associated information There are a number of r.trn instance.? where this might be 
appropriate; for example, local advertising, advertising making use of products 
appearing in a feature film, betting on the outcome of events, such as sporting events, 
and so on. Furthermore, the circumstance may arise, where a sponsor, for example, has 
an advertisement pioduccu, but docs nut kjiow al which time such this advert will be 
shown. In such a case, the transmission signal of the broadcaster in question may be 
monitored to detect the said advertisement at which point any PAD for that advert may 
be instantly cued. 

In one envisaged embodiment of such a monitoring system, each central processing 
station contains a database of various audio and/or video samples (supplied ahead of 
time) taken from the programmes (including advertisement and infomercials) which are 
to be augmented with data. A matching engine then continuously compares input from 
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the various broadcast channels with these samples, and uses a commonly known 
algorithm (such as a sliding- window, averaged, square-of-difleiciicc system with an 
activation threshold) to determine when a 'match' has occurred. Such a system may be 
utilised to determine that a piece of annotated content is being broadcast ai a certain 
time on a particular <medium, channel^ pair, which may in tuns allow the scheduler to 
verify or regain its synchronisation lock for the PAD items for that content. Through 
the transmission of special control messages, PAD items already sent to user devices 
may he rescheduled or deleted, without the main body of the message having to be 
retransmitted. 



The possibility of maintaining multiple, alternative lists of PAD items for a given 
<mediuiu, channcl> pair is acknowledged here, with selection of the appropriate list or 
lists at the user device, however, ihe primary focus in this exposition will he for the 
simpler case of a single b cuc list' per pair. 

When the next display message is due to be transmitted, as may be detected at the PAD 
scheduler A 1 1 using either a polling or, preferably, an interrupt mechanism, it is 
retrieved from a PAD database 408, given a unique identification number (PADUID), 
and sent to a transmission gateway 413, which may be physically remote, where it is 
translated into the correct format to be sent over a radio transmission 3crvicc 414. In the 
preferred embodiment of the present invention, the PAD would be sent using the text 
message transmission protocols of a cellular paging system, with a virtual 'recipient 
address' identified with the pair consisting of the medium and content broadcast 
channel in question, bur other formats are obviously possible. For example, the 
outbound PAD could be transmitted using 'data-hiding' technology over an existing 
radio broadcast channel, oj sent on a dedicated data radio channel or otherwise. 

From the gateway, the radio service provider 414 arranges for the transmission of the 
information over the service 414. In the preferred embodiment this involves sending the 
message using a cellular network of paging-transmitters. 



J! a 
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The message is received in a given user's home 4 1 6 by 1 cceiving apparatus 4 1 7, which 
in the preferred embodiment, is a remote control device for said broadcast receiver 403. 
In the preferred embodiment, the said remote control device 417 will contain a two-way 
paging chipset to allow reception and transmission of digital information in a ubiquitous 
and cost-efficient manner. The user 418 utilises the remote control device 417 10 select 
the channel to receive at any given time on a given broadcast receiver 405, and this 
allows the device 4 1 7 to select the appropriate stream of incoming PAD items. In the 
preferred embodiment, the selected channel and receiver uniquely specify a virtual 
'paging user id* to which the said two-way pager chipset may be set to be responsive. 

In an alternative envisaged embodiment., data is transmitted to the device using a radio 
subcarrier scheme, such as is provided by the SCA system in the United States. In 
another envisaged embodiment, the data transport mechanisms nf the Digital Audio 
Broadcasting (DAB) system arc used to transmit information to the device (as defined 
in ETS 300 401 - "Radio Broadcasting Systems, Digital Audio Broadcasting (DAB) to 
Mobile, Portable and Fixed Receivers"). 



The internal configuration of the remote control device 417 will be described lata. For 
Q now, simply note that the device 417 will display the incoming PAD display data to the 

il user at the appropriate cue point, and may accept interaction from the user on the basis 

C?1 of the information so displayed. Details of such interaction, where relevant, may be 

n transmitted back to the central control stannn 47.0, together with the unique v 

handset/user id (HUUID) and PADUID of the initial display data. In the preferred 
embodiment, encoding and transmission is performed by a two-wa y paging ch ipset in 
the remote control device, and picked up by the local cell receiver of a cn-operating 
paging service operator. However, other arrangements for reception of the return radio 
signal are possible. 



1/ 



For example, the system may make use of bandwidth available within a digital cellular 
telephony system, under some appropriate protocol (e.g. the Short Message Service of 
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GSM) Alternatively, the signal may be sem imu an unlicenced radio data network, for 
example, a metropolitan packet relay system. 

In any event, the return signal is picked up by the receivei network 415 of a radio 
service provider (which may or may not be the same as provider 414). and forwarded to 
a .eception gateway 4 1 2 This gateway formats the interaction data in a manner suitable 
for processing by the rest of the system, and arranges for the translated message to be 
transported to the appropriate central processing site 420 ( which may be physically 
remote. 

At the central processing site, the forwarded message is received by an interaction 
processor 407, which decodes and processes ihe interaction data. It makes use of the 
PAD database 408, in conjunction with the enclosed PADLUD. The enclosed HUUED is 
used to look up the user s record in a user database 410. Security mechanisms , 
incorporated into the message sent from the handset 417 to prevent fraud. 



arc 



There are a number of possible operations available to the interaction processor upon 
receipt of a message, and the use of a plug-in architect c here allows this set to be 
extended at will. Indeed, a separate handler may be registered fyj each PAD. if desired 
In any event, certain common actions will be possible. For example, the user's credit 
card details may be held in the user database 410 (indeed, if the remote control device is 
sold to the user by credit card, then this information will be immediately available after 
the sale), and used, in conjunction with the offer details from the PAD database 408 and 
vendor details from the vendor database 409 to formulate a financial transaction 
request, which may then be fyi warded to the sponsoring party in question 401. This 
forwarding may utilise such transports and protocols as are known in the an, and may 
interface to existing systems installed by the sponsor; for example, the request might be 
sent over the Internet, using the Secure Electronic Transactions (SET) protocol. 
Alternatively, the interaction might constitute a request for further information, in 
which case the sponsor will be so informed. Here, a convenient format may he a 'virtual 
hit' on the sponsor's Internet Web site, suitably tagged so tljat the sponsor is aware of 
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the mechanism through which the interest has been channelled. In yet another common 
transaction, details are passed back to broadcasters 402, allowing the production of 
genuinely interactive broadcasts for example, by allowing feedback voting on a talent 
contest, or program story line selection. 



processing station 420 over a known transport, such as the Internet, users will be able to 
review the transaction histories held in the database 410, and have access to all the 
facilities offered by the handset 417. but in greater detail and with full graphical 
support. It should be noted that use of a home computer 4] 9 is not necessary to the 
operation in the main of the present invention. 

As the user's name and address is held in the user database 410, the process of 
purchasing, or requesting the mail-out of information, is ^reatlv simplified. 

FIG. 5 is a functional block diagram of an embodiment of the remote control handset 
according to the instant invention, and FIG. 1 is a plan view of one embodiment of such 
a handset. 

Turning first to FIG. X we see that the user of the handset provides input to the device 
via input system 622, which in one preferred embodiment consists of a set of keys. 
This input is supplied to the core of a conventional remote control system, 614. This 
core system may be of any of the configurations well known and rehearsed in the an, 
such as vendor-specific, universal, learning, programmable, or otherwise. It consists of 
an input controller, which decodes ilic data from said input system 622. and invokes 
the appropriate response in the remote control driver 612. This driver will contain such 
means, well known in the art (e.g., ROM lookup tables, non-volatile RAM for * learnt* 
configurations, etc.), as are necessary for the operation of the device as a remote 
controller of the required type, and will be connected to infra-red transmitter 613. This 
will provide an infra-red signal 615, coded appropriately by 612 in response to the user 



Through use of an optional home computer 419 connected to the appropriate central 
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input from input system 622 as ducted by the input controller 61 1, which, in rum, will 
drive the remote consumer device (such as a broadcast receiver, VCR, etc). 

Depending on the type of jemote control device desired, v ar ious optional modules may 
be added to the remote conuol core 614. For example, a 'learning' remote control 
would need to have an infra-red < cceiver 617 connected to the driver 612, in order that 
inbound mfra-red signals 616 from (e.g.) a target handset could be recorded. Similarly 
a 'programmable' remote control may require a commnnications system 628 to allow ' 
the appropriate vendor specific codes l0 be downloaded from a remote she upon 
request. According to one preferred embodiment of the present invention this 
functionality of system 628 may be provided as a secondary function of the radio dau 
transceiver 603 (described below). 

As well as feeding the dnver 612 via output 623, the input controller 6 1 1 also p^es 
details of the invoked commands to the main processing system 604 withm the handset 
v.a output 624. This processing system-is responsible for dcali,* with the reception 
storage and display of incoming display data, and also handling any interaction with 
sa,d d 1S piay data from the user, including (where necessary) causing any resulting 
interaction data to be transmitted back to the central control system 420. 

The main processing system 604 contains a microprocessor 607 (which executes the 
software components of the user-side system), a real-time clock 626 used to determine 
(inter alia) when the cueing point of PAD items has been reached, a watchdog timer 
629 to reset the system should it become locked up for whatever reason, and various 
memory component, The latter may be split into: w yi ks P ace random access memory 
(RAM) 608, used to hold the ephemeral running state of programs exearting on the 
microprocessor 607. non-vofatile RAM 609 used to hold configuration information 
which must not be lost upon power ioss (such as, possibly, HUTJID informal, 
purchase records, display data that the user has requested be stored, and possibly system 
software or patches), and finally, rend-only non-volatile memory (ROM) 610, used to 
store non-changing Information in the system, such as core system software routines 
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According to one embodiment of the current system, the functions of all or part of the 
entire system 604 are piuvided by an appropriately chosen microcontroller, to reduce 
cost. 

According to another embodiment of die current system, either or both the input 
controller 61 1 and the remote control driver 612 are provided by the said 
microcontroller also, to reduce cost. 

The software running on the microprocessor 607 has die lesponsibility of storing 
display data pertaining to the currently selected channel of the currently selected 
biyadcast receiver. The microprocessor 607 knows which is the currently selected 
channel, because it monitors the data 624 sen t from the input controller 61 1, when a 
channel champ is detected, the new <medium, channel* pair is stored in the non- 
volatile RAM G09. The system software is so arranged that, as soon as may be 
practicable after die user switches on a broadcast receiver using the device, the 
microprocessor sends an output along the bus 624 to the input controller 63 1, to force 
the transmission of an appropriate infra-red code to the said receiver, to force the 
selection of a known starting channel. 



During operation, the microprocessor 607 may obtain extra information and 
confirmation about the current ^medium, channcl> pair, through the optional additional 
channel confirmation system 625. According to one embodiment of tire current 
invention, this is provided by a microphone and analogue-to-digital (A to D) convener, 
together with a system which periodically receives a set of expected amplitude value 
ratings for each <medium. channel> pair from the radio transceiver system 603, and 
provides a running best match between these using such value-set correlation 
mechanisms as are well known in the an. such as a sliding-window, averaged, squarc-of 
difference system with an activauun threshold. 



1S-JPN-2000 16:00 FROM MARKSSCLERK TO QSTROLEMK PAEER P.33-'67 



WO 99/045(58 




PCT/GB98/02152 



The currently selected <mcdium, channel poii affects what information is accepted fay 
the microprocessor from the radio transceiver system 603. According to the preferred 
embodiment, this will involve sending a control instruction to the pager reception 
circuitry to make it sensitive only to messages with the appropriate 'virtual' pager user 
id* corresponding to the said pair. 

The radio transceiver system 603 is the main method by which the device 
communicates with the appropriate central processing station 420, as discussed above. 
Inbound messages, transmineri as radio signals 613, are picked up by the radio data 
receiver 601, which functionality in the preferred embodiment will be provided by the 
rcccptioji portions of a two-way pager chipset. Said messages are then passed through 
the message security system 627. to ensure that ihey are legitimate. In one embodiment, 
this process involves deciyptins said inbound messages according to a public key 
algorithm. In another embodiment, it involves comparing a stared checksum on said 
inbound messages with the same checksum computed dynamically. 

Any messages which are picked up and successfully validated by the radio transceiver 
system 603 are fed to the microprocessor 607, where their <medium. channel> pair is 
checked against that stored in the non-volatile RAM 609. Those messages which do not 
match are discarded, whereas those which do match arc placed into a buffer in the 
workspace RAM 60S. This buffer clearly has a limited size, and, when the bufTci is full 
and a new message comes in. the PAD item (message) in the buffer with the cue point 
furthest away from the current time is discarded. Where possible, items which have 
interactive data stored are not discarded until either a timeout period elapses or the 
transaction is completed (in which case a summary may be written to the non-volatile 
RAM 609, and the item discaidcd if necessary). In the case of a tie, one PAD item is 
discarded at random. PAD items in the buffer are held in order of cue-up time. 

In an envisaged extension to the system, sufficient memory is provided that PAH items 
for a number of <medium, channel> pairs may be accumulated, not merely the 
currently selected pair, allowing for infonnation to be instantly available even when the 
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user skips to a new ^icdium, channel^ pah. The device may keep a record of ihe most 
commonly accessed <mcdium, channel> pairs in non-volatile RAM 609, ro help decide 
upon which PAD itcm3 to record. 

Each inbound message carries a timestamp which is set at transmission; this allows ihc 
real time clock 626 to be accurately maintained in synchronisation by the processor. 
When the device is used for the first time, messages for any <medium, channcl> pair 
are accepted, in order to quickly acquire an accurate timestamp to initialise the real time 
clock 67.6; however, said messages are not retained or displayed unless they do match 
the current pair. 

In another envisaged extension to the system, FAD items contain additional descriptive 
information - metadata - which allows them to be selectively retained and displayed 
according to the profile of each particular user. This profile, which may be held in the 
non-volatile RAM 609, may be used to match PAD to users on criteria such as age, sex, 
geographical location, and so on. 



In yet another envisaged extension to the system, the profiles of users arc held, and may 
to some extent be generated, at the central processing site (420 in FIG. 3). These 
profiles, stored in the user database (410 in FIG. 3) are matched against metadata- 
tagged PAD items in the PAD database (408 in FIG. 3). A matching list of users is 
compiled, and this information (in the form of unique user ids) is appended to the 
appropriate PAD items prior to transmission. Upon receprinn at a device, the currently 
active user id is matched against the said list of users, and only those PAD items which 
do match arc retained and displayed. 

Special control messages may alio be used, which will force the message corresponding 
to a specified PADUID to be flushed from the meiiioiy of receiving devices, or undergo 
modification of various types, including change of cuc-up time. 
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The cue point for each HA!) item is also specified as a real time point, with an optional 
special case of 'display immediately' which may be relevant in certain circumstances. 
The system does not require that PAD items he Transmitted from the control centre in 
the order that they are to be displayed, since this is control led by the aforementioned 
cue-up point. 



The microprocessor 607 is responsible for initiating a display routine for each PAD 
item as its cue-up point is reached by the real time clock 626. It will detect such an 
event either through the use of an interrupt created by the real lime clock 626, or hy 
continuous polling. The former mechanism is to be preferred where possible. It may 
also invoke additional output systems 621 to attract the user's attention to the new 
display data. In the preferred embodiment of the current invention, such additional 
output systems will include a piezoelectric buzzer, and a flashing LED. The user may 
disable these systems if so desired. 

The display routine executes the program unit associated with the appropriate PAD 
item. (In this sense, we may regard the display data as being an object, on which a 
'display* method is invoked.) This program unit may make use of a set of core library 
routines stored in either or both of the ROM 610 and nnn-votatile RAM 609, to assist 
its operation. The microprocessor executes display routines using a pre-emptive 
strategy, to prevent the device becoming locked up due to an endless loop hug in such a 
routine. The watchdog timer 629 will reset the microprocessor should a bug in the 
display routine (or some other problem) cause the system to lock up. 

To actually generate a display on the device, the display routine of the active PAD item 
may call various utility library routines, which cause the microprocessor 607 to issue 
commands to the display system 605. This system contains a display controller 620, 
responsible for translating the high-level commands sent from the microprocessor 607 
into whatever low level display control signals may be required by the actual display 
system involved 606. In the preferred embodiment of the current invention, the display 
is rendered as a multi-line pixel-addressed LCD screen. 
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Other library routines available 10 an executing display routine provide (inter alia) read 
and write access to the various memory siores (608, 609 and 610) of the device, allow 
data to be passed to the input controller 61 1 via the bus 624, and allow messages to be 
sent back to the main control centre (and so, possibly, to a sponsoring party, a 
broadcaster, or otherwise). This latter functionality causes information to be sent to the 
radio data transmitter 602 of the radio transceiver system 603, having first passed 
through the message security system 627. According to the preferred embodiment of 
the current invention, this will involve providing at least a checksum for non-critical 
outgoing messages, and pubiic-key encryption for critical messages, together with a 
message digest generated using a special key which makes use, in cyclical series, of a 
unique list of values held wilhin the non-volaiilc RAM 609 uf ihc device installed at 
manufacture and modifiable ai laici limes. Messages are sent from the device usinu 
radio emissions 619. 

Routines will also exist to allow the display routine to receive information back from 
the appropriate main control centre in response to a message sent; this cyclical process 
may continue for as long as necessary. Using further library routines, a display routine 
may notify the system that the user's interaction has reached a logical ending point, 
which will allow the PAD item to be flushed if required. 

Turning now to FIG. 6, we can see an alternative embodiment of the current invention 
in which an adaptor unit 701, providing the facilities of the interactive set of controls (3 
on FIG. 1) found on the preferred embodiment discussed cailici, can fit uvci a user's 
existing remote control unit 704. The "host" handset 704 contains, inter alia, an infra- 
red transmitter 703 ( which emits control signals 705 in response to user input. The 
adaptor unit 701 is so designed that the emitted signals 705 are passed through and 
permitted to emit from window 702 as signals 706. However, the device 701 also 
contains an infra-red receiver, which samples the signal 70S, allowing the unit to 
identify the control signal which is being sent. When the control signal represents a 
command to change the current <medium, channel> pair, the device 701 switches its 
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PAD display and reception accordingly. The adaptor and host handset are shown in 
"exploded" form in FIG. 6; in normal use they would be joined together 706. 

Turning now to FIG. 1, we can see the controls that would commonly be picsciit on an 
embodiment of the remote control handset I according to the present invention. 

The handset controls are split into two major groups. The first set 2 contains controls 
that are commonly found on conventional remote control devices, and the second set 3 
contains controls specific to the interactive and innovative features of the current 
invention Commands generated by the device are sent through as infra-red code 
sequences through the window 1 7. 

Keypad 4 allows for the selection of channels as desired on the current broadcast 
receiver device, which in rum may be chosen usin S the keys 8. Controls 5 allow cycling 
through channels, and level-set controls 6 provide a means to adjust volume, brightness 
etc. Finally, there is a subset of other controls 7 which perform various functions, such 
as turning the target broadcast receiver on and off, muting the device, and so on. 

In the set of interactive controls 3, we. have a multi-line, pixel addressed LCD display 
14 on which display data may he shown. Controls 13 and 15 may be exercised to 
invoke options shown on the screen, at the bottom and sides respectively. For example, 
n in the configuration shown in FIG. 1 , pressing the third triangular button from the left 

would cause the number of items ordered to increment by 1. 

Users may traverse ihiough the set of display data in memory using the forward and 
back keys 12. Newly displayed PAD items may be announced through the. use of a 
piezoelecuic buacr 1 1 and a flashing LED 10. The 'lock' button 1 6, if pressed, 
removes purchasing authority from the handset until the. user re-enters his or her PIN 
code. The 'Buy Now! ' button 9 acts as a confirmation button for the current screen. 
Where no entry has been made on a screen, pressing button 9 will select the default 
values, if any. 
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Trcssing some combination of keys (such as any two of 15. for example) will bring up a 
main, master menu allowing navigation to various subscreens. 

FIG. 4 illustrates a simple example of an embodiment of the handset remote control 
device 502 of the present invention in use. Broadcast receiver 501 is displaying a 
television programme - "The Tool Show" - and as the presenter starts to demonstrate 
the use of good drilling technique 503. the handset 502 displays a programme-related 
offer 504 for the drill that the presenter is using. The PAD item corresponding to this 
Offer will have been downloaded to the device from the relevant central processing 
Station 420 (Figure 3) at some point previously, and cued up at the appropriate point for 
display by the mechanisms rehearsed above. 

In order that o better understanding of some of the uses of the handset remote control 
device of the present invention may be appreciated, some exemplary displays from one 
embodiment shall now be considered, with reference to FIGS. 2A through 2L. These 
displays are intended as illustration only and should not be interpreted as limiting the 
invention. 

Hli. 2A illustrates the offer screen of the example Horn FIG. 4, after some interaction. 
Line 101 contains a brief description ur die product, and line 103 gives pricing 
information. Indicia 102 shows that there are currently 3 PAD items in memory for the 
current <nicdium, channel> pair, of which the currently displayed item is the second. 
Lines 104 give brief information about the current order and the total cost of that order 
if actually purchased. Below this are indicators of the functions for the variant selector 
buttons below (13 on FIG. 1). The 'BUY' button 105 will initiate a purchase (similar to 
pressing the 'BUY NOW!' button, 9 on FIG. 1). The 'INKO' button 106 will bring up a 
screen giving further information about the offered product. The variable function 
buttons corresponding to the '+1 ' and labels (107 and 108. respectively) increase 
and decrease the number of units of the product ordered. 



a .5 
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If the user opts to buy. that Hit screen of FIG. 2C is shown, which contains a request to 
confirm the Transaction 1 14, a selection of credit and/or debit cards 113 to choose fium 
(chosen by pressing uue of the side variable function buttons, 15 on HO. 1). and die 
option to cancel the transaction 1 17. Selecting a credtt card will bring up a Successful 
order* screen, not shown here. 

The screen of FIG. 2B is an example of an otter of information, which might be timed 
to run alongside an advertisement appearing on the complementary primary broadcast. 
Here, the user is prompted 109, 11 1, 1 12 to press the third fium left bottom variable 
function bunon (13 on FIG. 1), which will cause a message to be sent back to the 
sponsor, who will then have the details necessary to send the user an information pack 
about the product 1 10. Pressing the "BUY NOW!' button (9 on FIG. 1) will also have 
this effect, since it selects the default action 0 u each screen. Once again, we see that the 
PAD item displayed is one of several 102 (in this case, the last of 4). 

Another use of the system is for interactive voting on broadcast content, and FIG. 2D 
shows how the display mi S ut look when this feature is in use. Here, the user is 
prompted 116 to an* his/her vote for one of the acts 1 1 S (in a talent show, for 
example), by pressing one of the side variable function buttons (15 on FIG. 1). 

Figure 2E illustrates a simple channel guide for the currently selected <medium, 
channel> pair. A short listing of programmes for the current pair, together with start 
times, is siven 216. A cursor 203 may be scrolled up and down the list using the bottom 
variable function buttons (H on FIG. 1) corresponding to 206 and 205 respectively; and 
h is possible to have a list longer than the screen of which a window is displayed during 
scrolling, in the familiar manner. Indicia 201 shows the programme currently being 
broadcast. The current time 202 is shown, along with an indication of the current 
^medium, r.hannel> pair 215 (in this case, the third channel on a television timer is 
selected). The currently selected programme may have further information available 
•bout it, in which case label 204 will appear, and the bottom variable function bunon 
corresponding to it (fium 13 on FIG. 1) may be pressed. 
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lf to is done a screen such as IU««d in HB. * * '» <** 1— • . 

Ration *« *• — » «"*—" " ^ ^ b T 

*. screen, theuser ma, scroll up and down throupi, ,, usin g the bouom vanab.c 
tad- bunons -espondu* to 209 and 2.0. respect CNotc ft* ,n =1. 

scroll, thebouon, Unc contain^ me^ion ■**«— 
current time 1 02 is also shown. 

FKS M musics how the sv»«m may be used as a berth* termini, "her. the d«ails 
of, he even, so bet upon may be breads on thecurrenuy >W«te 
Cannes pah. Here, a simp,. Horse racing screen is show. The user is prompred ,0 
sel ect place a be, and 1* of the rime available so . Co 212. Venous horses 
selected by pressing the approve side variable fcnetion bunon (IS on FKi Note 
ft. ibis is a simplified «xam Pl e. and in reaihv, such a system wouid dea, 
ft, wager, displaying, more information, including . 1«S« °* 
candidates, etc. 

^ ft, handset is locked fc, purchase, by pressing me -LOCK' bunon (.6 on nO. 1) 
or otherwise, the screen shown is FIG. 2H is disp.ay«. when a purchase is an.mp.cd. 
Here, the user is prompt 2.3 to enter a feur-di S , HN 214. which will un>.ck the 
device The device may be sc. to automatically lock if unused for more than a cenatn 
period of time. TheWN will be entered using the keypad (4 on HO. 1). 

„ the handset is power., down or left unused for a significant period of toe it will 
.ever. . a mod. in which the user identity -us. be so, . Mussed in FIG. 2K. Here, 
the handset has ftre. users within a household 308. Mike, and Robert. The user 
is prompted to select his or her identity 30* by pressing ft. correspond™, side van*l. 
fcLion bunon (.5 in FIG 1). Once a user is selected, screen 2H may be displayed for 
verification. The handse, device may utilise a cepacia swneh to detect hanul,ng and 
initiate the power on cycle. 



1B-JRN-2003 IS: 02 PROM MPRkS2.CL.ERK TO OSTROLEMK FREER P 

^»>CT/GBV»/a2iS2 

WO 99/04568 

. 26 

In FIG. 7A, we see an alternative embodiment of the current invention, in which no 
remote control functionality is present. Here, a portable device 801, providing the 
facilities of the interactive set of controls (3 on FIG. 1) found on the preferred 
embodiment discussed earlier, and which may also provide conventional pager 
functionality, contains a microphone 802 by which it continuously monitors its 
surrounding audio environment. Under normal viewing or listening circumstances, the 
audio input SCO to microphone 802 will contain a large component due to the 
programme currently being broadcast on the current <medium, channel* pair. 

Having taken a series of audio observations across a short time window, the device 
performs a sliding match against a set of audio "fingerprints' ' (which are m mm 
received periodically from the appropriate central processing station (420 in FIG. 3) via 
radio link). The matching may use any of the value-senes comparison metrics as are 
knuwn in the an, such as least difference squared summation. If this process yields a 
unique match to a "fingerprint" of a <medn.m > channel pair with sufficient 
confidence, then that pair will be used to control the current display and acceptance of 
PAD by the device. 

FIG. 7B shows another alternative embodiment of the current invention, in which a 
portable device 804. similar in most respects to the device of FIG. 7A just considered, 
requires user input to select the cuueui <mcdium, channel* pair. The user may cause 
the device to show display 81 1, in which s/hc is prompted to enter the currently selected 
medium 809 and channel 810. To perform this selection, the user may move the 
selection cuisors using the variable function buttons corresponding to the "medium" up 
and down and "channel" up and down labels (805, 806, 808 and 807 respectively). The 
selected pair is subsequently used to control the display and acceptance of PAD by the 
device, but docs not cause the emission of control signals to a broadcast receiver. 

The system may be used with a number of different types of broadcast receiver, and 
FIG. 21 shows the sort of display that might be shown to accompany radio broadcasts. 
Details of the current station are Shown 301. and aii indication of the receiver type 312. 
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303 As before, a number of PAD items may be held in memory, and the pes*™ of the 
currently displayed item is show. 302. By prying the bottom variant Action key (13 
i„ HG 1) corresponding to the "INFO' label 304, the user may brin 2 up another 

on riG 

„ will be prompted wHh father confirmation screens (not shown in detail here). 

PIGS ail Ki2L«^«i^~^^^ rftotoiCe,ktt A 

difec tly connected with p^amme-associated mat,nal. In FIG. 2J the user is prompted 
306 to enter a package tucking code 307 (as used by some document and parcel 
dehvery companion may then initiate a remote query to display to the userthe 
current location of the specified package (using screens not shown). Sim.lariy, FIG. 2L 
grates a • shop from home' usage, in which the user b prompted 3 10 to enter a J0 mt 
product/vendor identification code 11 1 This will initiate a remote query to d.splay 
^formation about the product so identified, in a manner similar to that used by PAH 
poduct offers (as show. ,» HG. 2A. for example); if this is successful the user may 
initiate a purchase, » with the PAD example discussed previously. In both cases, the 
details would he entered via the keypad (4 in FIG. 1). 

Although illustrative embodiments of the present invention have been douibed in 
netail with reference to the accompanying drawing,, it is to be undeistood that the 
invention is not limited to those precise embodiments and that changes and 
modifications may be made by those skilled in the art without departing from the scope 
and spirit of the invention. 

Moreover, any application or patent cited herein should be considered to be 
incorporated by reference as to any subject matter deemed essential to the present 

disclosure. 



